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Abstract 

Brandenburger  and  Dekel  have  shown  that  common  belief  of  rationality  (CBR)  characterizes 
rationalizable  strategies,  which  are  also  characterized  by  a  refinement  of  subjective  correlated  equi¬ 
librium  called  a  posteriori  equilibrium.  It  is  possible  that  players’  beliefs  are  incompatible,  in  the 
sense  that  player  i  can  assign  probability  1  to  an  event  E  to  which  player  j  assigns  probability 
0.  One  way  to  block  incompatibility  is  to  assume  a  common  prior.  We  consider  here  a  different 
approach:  we  require  players’  beliefs  to  be  consen’ative ,  in  the  sense  that  all  players  must  ascribe 
the  actual  world  positive  probability.  Aumann  has  shown  that,  under  the  common  prior  assumption 
(CPA),  common  belief  of  rationality  characterizes  strategies  in  the  support  of  an  objective  correlated 
equilibrium.  Under  the  CPA,  without  loss  of  generality,  all  players’  beliefs  can  be  assumed  to  be 
conservative.  We  consider  the  consequences  of  common  convervative  belief  of  rationality  (CCBR), 
without  the  common  prior  assumption.  We  show  that  CCBR  characterizes  strategies  in  the  support 
of  a  subjective  correlated  equilibrium  where  all  players’  beliefs  have  common  support.  We  also 
define  a  notion  of  strong  rationalizability,  and  show  that  this  is  characterized  by  CCBR. 
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1  Introduction 


In  the  Bayesian  view  of  the  world,  each  player  has  a  subjective  probability  distribution  (describing  her 
beliefs)  over  the  states  of  the  world.  In  general,  player’s  beliefs  may  be  incompatible,  in  the  sense  that 
one  player  might  believe  that  an  event  E  has  probability  1 ,  while  another  might  ascribe  E  probability  0. 
(Technically,  this  says  that  player’s  beliefs  may  not  be  absolutely  continuous  with  respect  to  each  other.) 
One  way  to  assure  that  players’  beliefs  arc  compatible  is  to  make  the  common  prior  assumption  (i.e., 
each  player’s  beliefs  arc  generated  by  conditioning  a  common  prior  on  the  player’s  information).  Here 
we  consider  a  different  approach  to  ensuring  that  players’  beliefs  arc  compatible:  we  restrict  to  beliefs 
that  are  conservative,  where  player  V s  beliefs  arc  conservative  if  player  i  ascribes  positive  probability 
to  the  actual  state.1  If  a  player  starts  off  with  a  subjective  prior  assigning  non-zero  probability  to  all 
states  of  the  world,  and  updates  by  conditioning  on  information  received,  then  his  beliefs  will  always 
be  conservative.  Note  that  with  conservative  beliefs,  players  will  never  be  “surprised” — they  will  never 
find  themselves  in  a  position  to  which  they  initially  assigned  probability  0. 

Tan  and  Werlang  [1988]  and  Brandenburger  and  Dekel  [1987]  show  that  common  belief  of  ratio¬ 
nality  (CBR)  characterizes  rationalizable  strategies  [Bernheim  1984;  Pearce  1984].  Brandenburger  and 
Dekel  [1987]  further  show  that  rationalizable  strategies  are  exactly  those  in  the  support  of  an  a  posteri¬ 
ori  equilibrium,  a  special  case  of  a  subjective  correlated  equilibrium  (SCE)  [Aumann  1974], 2  Aumann 
[1987]  shows  that,  under  the  common  prior  assumption  (CPA),  CBR  is  characterized  by  strategies  in 
the  support  of  an  objective  correlated  equilibrium  (CE).3  Here  we  will  be  interested  in  what  happens 
to  these  results  if  we  restrict  to  conservative  beliefs;  more  specifically,  we  will  be  interested  in  the 
consequences  of  common  consetyative  belief  of  rationality  (CCBR).  Under  the  CPA,  players’  beliefs  re¬ 
garding  rationality  can  always  be  taken  to  be  conservative,  so  under  the  CPA,  CBR  and  CCBR  coincide 
(see  Appendix  B  for  a  formalization  of  this  statement).  Without  the  CPA,  this  is  no  longer  the  case:  as 
is  well  known,  in  the  normal-form  version  of  the  centipede  game  [Rosenthal  1982],  all  pure  strategies 
are  rationalizable,  and  can  thus  be  played  in  a  world  where  CBR  holds;  in  contrast,  CCBR  implies  the 
backward  induction  solution  (even  without  a  common  prior). 

Our  main  result  is  a  characterization  of  CCBR  without  the  common  prior  assumption.  We  first  show 
that  CCBR  characterizes  strategies  that  satisfy  a  notion  of  strong  rationalizability;  roughly  speaking, 
this  notion  is  identical  to  the  traditional  notion  of  rationalizability  with  an  additional  absolute  conti¬ 
nuity  condition — if  one  player  assigns  positive  probability  to  some  strategy  profile,  then  all  players 
assign  positive  probability  to  this  profile.  We  next  establish  an  analogue  of  the  Brandenburger-Dekel 
result,  showing  that  strongly  rationalizable  strategies  arc  exactly  those  in  the  support  of  a  SCE  where 
all  players’  beliefs  have  common  support;  we  call  this  a  common-support  subjective  correlated  equilib¬ 
rium  (CS-SCE).  Interestingly,  Aumann  already  alluded  to  such  a  notion  in  his  original  paper  defining 
correlated  equilibrium  [Aumann  1974],  but,  as  far  as  we  know,  it  has  not  been  investigated  further. 
Since  every  CE  is  a  a  CS-SCE,  our  charaterization  of  CCBR  in  terms  of  CS-SCE  shows  that  strategies 

'Actually,  this  is  the  case  only  if  the  state  space  is  finite.  In  general,  we  require  that  the  actual  state  be  in  the  support  of 
player  i’s  beliefs. 

2Roughly  speaking,  a  subjective  correlated  equilibrium  of  a  game  G  is  an  equilibrium  resulting  from  augmenting  G  with 
a  mediator  who  gives  players  “advice”,  where  players  may  have  different  subjective  probabilities  on  the  likelihood  of  various 
pieces  of  advice  being  given. 

3That  is,  the  players  can  now  be  viewed  as  playing  with  a  mediator  who  gives  advice,  and  have  common  beliefs  about  the 
likelihood  of  various  pieces  of  advice  being  given. 
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consistent  with  CCBR  always  exists  in  finite  games.  So,  to  informally  summarize  this  discussion,  we 
have  three  distinct  “epistemic”  solution  concepts — “CBR+CPA  =  CCBR+CPA  <  CCBR  <  CBR” — 
corresponding,  respectively,  to  the  equilibrium  notions  of  CE,  CS-SCE,  and  a  posteriori  equilibrium. 

The  work  closest  to  ours  is  that  of  Stuart  [1997],  who  considers  the  consequences  of  CBR  under 
the  assumption  that  players’  beliefs  satisfy  a  valiant  of  the  notion  of  mutual  absolute  continuity  (MAC). 
This  condition  implies  that  it  is  a  common  belief  that  players  assign  positive  probability  to  the  true 
state  of  the  world.  That  is,  it  is  common  belief  that  players’  beliefs  are  conservative  (although  this  may 
not  be  true).  Stuart  shows  that  in  the  finitely  repeated  prisoner’s  dilemma,  CBR+MAC  suffices  to  get 
the  backward  induction  outcome,  but,  in  general,  CBR+MAC  does  not  imply  that  a  Nash  equilibrium 
outcome  is  played  in  games  of  perfect  information.  Stuart,  however,  does  not  provide  a  characterization 
of  the  set  of  strategies  consistent  with  CBR+MAC. 

A  strategy  is  consistent  with  CBR+MAC  iff  it  is  consistent  with  CCBR  (see  Appendix  B  for  a  for¬ 
malization  of  this  statement).  Thus,  in  a  sense,  conservative  beliefs  and  mutually  absolutely  continuous 
beliefs,  while  different  ways  of  charcterizing  compatibility  of  players’  beliefs,  turn  out  to  be  essentially 
equivalent  in  the  context  of  common  belief  of  rationality.  Our  results  thus  also  provide  a  characterization 
of  strategies  consistent  with  CBR+MAC. 

Ben-Porath  [1997]  considers  conservative  beliefs  in  the  context  of  extensive-form  games;  roughly 
speaking,  he  shows  (in  our  language)  that  if  CCBR  holds  and,  in  addition,  the  support  of  each  player’s 
beliefs  is  common  belief,  then  the  outcome  of  play  is  a  Nash  equilibrium  outcome. 

The  rest  of  the  paper  is  organized  as  follows.  In  the  next  section,  we  define  a  logical  language  and 
models  for  reasoning  about  (conservative)  belief  and  common  (conservative)  belief  in  games.  In  Sec¬ 
tion  3,  we  define  strong  rationalizability,  show  that  it  is  characterized  by  CCBR,  and,  finally,  show  that 
strong  rationalizability  characterizes  common-support  subjective  correlated  equilibrium.  To  simplify 
the  exposition,  we  consider  only  finite  models  here.  This  means  that  we  arc  considering  only  finitely 
many  types  of  players.4 

2  Kripke  structures  for  games 

We  consider  normal-form  games  with  n  players.  Given  a  (normal-form)  n-player  game  T,  let  Sj(T) 
denote  the  strategies  of  player  i  in  T.  To  reason  about  the  game  T,  we  consider  a  class  of  proba¬ 
bility  structures  corresponding  to  T.  A  finite  probability  structure  M  appropriate  for  T  is  a  tuple 
(fi,  s,  VTZi, . . .  ,V1Zn),  where  is  a  finite  set  of  states;  s  associates  with  each  state  u>  €  17  a  pure 
strategy  profile  s(cu)  in  the  game  T;  and,  for  each  player  i,  'P'JZ,  associates  with  each  state  oj  G  ft  a 
probability  distribution  VTZfiut)  on  17  such  that 

1.  T,7^i:(w)([sj(a;)]]w)  =  1,  where  for  each  strategy  cq  for  player  i,  =  {w  :  s fioo)  =  cq},  and 

s,  (+’)  denotes  player  rs  strategy  in  the  strategy  profile  s(cc), 

2.  /P7Zi(uj)(l'P7Zi(uj) ,  i}m)  =  E  where  for  each  probability  measure  ir  and  player  i,  [7r,  i\m  =  {cc  : 
VTZi(u)  =  7T } . 

4The  restriction  to  finite  models  is  essentially  without  loss  of  generality  if  we  assume  that  the  support  of  all  probability 
measures  in  the  model  has  probability  1.  While  this  assumption  does  not  hold  in  general,  it  is  satisfied  under  a  number  of 
standard  topological  assumptions;  see  [Halpern  and  Pass  2011]  for  more  details. 
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These  assumptions  say  that  player  i  assigns  probability  1  to  his  actual  strategy  and  beliefs.  (We  have 
implicitly  assumed  that  all  sets  in  finite  structures  arc  measurable.) 

Given  a  probability  structure  M  =  (O.  s,  VTZ\ , . . . ,  VlZn),  let 

•  play^di)  (“player  i  plays  er/’)  be  the  set  of  states  uj  £  such  that  ny  =  Sj(cu); 

•  RATi  (“player  i  is  rational”)  be  the  set  of  states  uj  €  Q  such  that  Sj(w)  is  a  best  response,  given 
player  i’ s  beliefs  on  the  strategies  of  other  players  induced  by  V'Rfuj):  and  let 

•  B i(E)  (“player  i  believes  E”)  be  the  set  of  states  uj  G  Q  such  that  PR.,  =  1. 

Let  RAT  =  RAT  i  n  . . .  n  RATn  and  play  {a )  =  play1(cr  i)  n  . . .  n  playn(an). 

We  next  define  the  conservative  belief  operator  B*.  We  want  to  capture  the  intuition  that  if  a  player 
has  a  conservative  belief,  the  player  should  not  rule  out  anything  he  has  not  observed  evidence  against. 
This,  in  particular,  means  that  the  player  should  assign  positive  probability  to  all  events  that  occur  in  the 
true  state  of  the  world  (as  he  could  never  have  observed  evidence  against  them).  One  way  to  formalize 
this  would  be  to  restrict  to  structures  where  all  players’  beliefs  satisfy  this  condition  (as  in  Aumann’s 
[1974]  model).  In  order  to  consider  statements  involving  both  belief  and  conservative  belief  (and  to  be 
able  to  compare  CCBR  with  CPA+CBR),  we  want  to  allow  models  where  worlds  can  have  probablity 
0.  Roughly  speaking,  we  say  that  conservative  belief  of  event  E  holds  in  a  world  uj  iff  (a)  the  agent 
believes  E  at  uj  (i.e.,  the  agent’s  probability  measure  at  uj  assigns  E  probability  1)  and  (b)  the  agent 
assigns  uj  positive  probability.5  Formally,  let  Suppiv)  denote  the  support  of  the  probability  measure 
7 r.  Say  that  a  state  uj  is  i-conservative  if  uj  £  Supp(VlZi(oj)) — roughly  speaking,  agent  V s  probability 
distribution  at  c j  assigns  positive  probability  to  uj.  Say  that  uj  is  conservative  if  uj  is  i-conservative  for 
all  agents  i. 

•  Let  B*(E)  (“player  i  conservatively  believes  E”)  be  the  set  of  states  uj  £  B  fE)  such  that  uj  is 
i-conservative. 

Let  EB(E)  (“everyone  believes  E”)  be  defined  as  Bi(E)  n  . . .  n  B n(E);  and  define  EBfc(E)  for  all  k 
inductively  by  letting  EB1(E)  =  EB (E)  and  EB k+1(E)  =  EB(EB k(E)).  Let  EB *(E)  (“everyone 
conservatively  believes  E”)  be  B[(E)  n  . . .  fl  B*(E),  and  define  (EB*)fc  analogously  to  EBfc.  Let 
CB(E)  (“common  belief  of  E  holds”)  be  n/c>iEBfc(£'),  and  let  CB *(E)  (“common  conservative 
belief  of  E  holds”)  be  r\>i(EB*)fc(£').  The  following  observation  will  prove  useful. 

Lemma  2.1:  If  T  is  a  game,  M  =  (f l,  s,  PP\ , . . . ,  VlZn)  is  a  finite  structure  that  is  appropriate  for  T, 
and  uj  £  CB*  (RAT),  then  for  all  players  j,  Supp(VlZj{uj))  C  CB*  (RAT). 

Proof:  Suppose  that  uj  £  CB* (RAT)  and  a /  £  Supp(VIZj(uj)).  Since  uj  £  (EB *)k(RAT),  it 
follows  that  uj  £  Bj((EB*)k~1(RAT)),  so  uS  £  (EB*)*-1  (RAT).  Thus,  J  £  CB *(RAT).  Hence, 
Supp(VIZj(uj))  C  CB* (RAT).  | 


Tn  an  earlier  version  of  this  paper  [Halpern  and  Pass  201 1],  we  used  a  logic-based  approach,  and  defined  events  E  based 
on  formulas  ip  in  some  underlying  logic.  We  took  conservative  belief  of  ip  to  hold  if  ip  was  valid — true  in  all  states  in  all 
structures.  This  meant,  for  example,  that  an  agent  i  would  conservatively  believe  true  in  all  states,  even  ones  that  he  did  not 
assign  positive  probability.  While  this  made  the  resulting  logic  more  similar  in  spirit  to  standard  modal  logics,  it  was  an  ad 
hoc  assumption  and  made  the  semantics  more  complicated.  Since  the  assumption  played  no  role  in  any  of  our  results,  we  have 
not  made  it  here. 
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3  Characterizing  CCBR 


To  put  our  result  into  context,  we  first  restate  the  characterizations  of  rationalizability  given  by  Tan  and 
Werlang  [1988]  and  Brandenburger  and  Dekel  [1987]  in  our  language.  We  first  recall  Pearce's  [1984] 
definition  of  rationalizability. 

Definition  3.1:  A  strategy  ex*  for  player  i  in  game  T  is  rationalizable  if,  for  each  player  j,  there  is  a  set 
Zj  C  SAT)  and,  for  each  strategy  ex'  6  Zj,  a  probability  measure  Pa'  on  S_,-(T)  whose  support  is  a 
subset  of  Z_j  such  that 

•  <7j  G  Zi\  and 

•  for  each  player  j  and  strategy  ex'-  G  Zj,  strategy  ex'  is  a  best  response  to  (the  beliefs)  . 


Theorem  3.2:  [Brandenburger  and  Dekel  1987;  Tan  and  Werlang  1988]  ex,;  is  a  rationalizable  strategy 
for  i  in  a  game  T  iff  there  exists  a  finite  structure  M  that  is  appropriate  for  T  and  a  state  uj  such  that 
u  G  CB(RAT)  n  playfaf). 

It  is  well-known  [  Pearce  1984]  that  a  strategy  is  rationalizable  iff  it  survives  iterated  deletion  of 
strongly  dominated  strategies.  Thus,  the  characterization  of  rationalizability  in  Theorem  3.2  is  also 
a  characterization  of  strategies  that  survive  iterated  deletion  of  strongly  dominated  strategies.  As  a 
result,  common  belief  of  rationality  is  always  consistent — that  is,  every  finite  game  has  a  structure 
where  common  belief  of  rationality  holds.  Furthermore,  since  iterated  deletion  of  strongly  dominated 
strategies  can  be  done  in  polynomial  time,  there  exists  an  efficient  procedure  that  for  every  player  finds 
a  strategy  that  is  consistent  with  common  belief  of  rationality. 

Clearly  CCBR  implies  CBR,  so  in  a  state  satisfying  CCBR,  the  strategies  used  must  be  rationaliz¬ 
able.  However,  not  all  rationalizable  strategies  can  be  played  in  a  state  satisfying  CCBR  (see  Appendix 
A  for  an  example).  We  now  introduce  a  strengthening  of  the  notion  of  rationalizability  called  strong 
rationalizability,  which  characterizes  strategies  consistent  with  CCBR.  Roughly  speaking,  this  notion 
is  defined  just  as  the  traditional  notion  of  rationalizability,  but  with  an  additional  “absolute  continuity” 
condition. 

Definition  3.3:  A  strategy  ex*  for  player  i  in  game  T  is  strongly  rationalizable  if,  for  each  player  j,  there 
is  a  set  Zj  C  Zj  (T)  and,  for  each  strategy  ex'  G  Zj,  a  probability  measure  /  v  on  S_ j  (T)  whose  support 
is  a  subset  of  Z_j  such  that 

1.  <7 1  G  Zi, 

2.  for  all  players  j  and  strategies  ex'  G  Zj,  o'j  is  a  best  response  to  (the  beliefs)  pai. ;  and 

3.  for  all  players  j,  h  and  all  strategy  profiles  ex'  G  Z\  x  •  •  •  x  Zn,  if  /v  (ex'  ■)  >  0,  then  /v  (ex'_  , )  > 

j  J  h 

0. 


We  now  show  that  a  strategy  is  strongly  rationalizable  iff  it  is  played  in  a  world  where  CCBR  holds. 

Theorem  3.4:  o  i  is  a  strongly  rationalizable  strategy  for  i  in  a  game  F  iff  there  exists  a  finite  structure 
M  that  is  appropriate  for  V  and  a  state  oj  such  that  oj  G  CB*  (RAT)  n  playfiof). 

Proof:  For  the  “only  if”  direction,  suppose  that  ot  is  strongly  rationalizable.  Choose  Zj  C  Z:J  ( F )  and 
measures  p  >  for  each  strategy  o'-  G  Z,  guaranteed  to  exist  by  Definition  3.3.  Define  an  appropriate 

j  J  J 

structure  M  =  (il,  s.  VIZ i, . . . ,  Wn),  where 

•  D  =  {o'  G  Z\  x  ■  ■  ■  x  Zn  :  there  exists  a  player  j  such  that  /v.  (v'-j)  >  0}i 

•  s  (o')  =  o'\ 

•  VlZj(o')(o")  =  0  if  o)  o'-,  and  VlZj(o')(o")  =  Pa'-W-j)  otherwise.  (Note  that  this  is  a 
well-defined  probability  distribution  since,  if  o"_  -  G  Supp(paj),  then  (o'-,  o"_A  G  fh) 

J  j  J  J 

Since  Oi  G  Zx,  there  exists  some  state  oj  G  D  such  that  sfioj)  =  o%.  By  Condition  2  in  the  definition 
of  strong  rationalizability,  each  player  is  best  responding  to  his  beliefs  at  every  state,  so  we  have  that 
o'  G  RAT  for  all  states  o' .  We  next  show  that  for  every  player  j  and  every  strategy  profile  o'  G  D,  we 
have  that  Wj(o')({o'})  >  0.  This  will  show  that  every  state  in  Q  is  conservative.  For  suppose  that 
o'  G  fh  By  definition,  VlZj(o')({o'})  =  pa'(o'_A.  Furthermore,  recall  that  o'  G  D  iff  there  exists 
some  h  such  that  /iCT/  (o’_h)  >  0.  By  Condition  3  in  the  definition  of  strong  rationalizability,  we  have 
that  if  pa'h  (o'__h)  >  6,  then  pai  (o'_3)  >  0,  and  thus  VRj(o')({o'})  >  0.  It  now  easily  follows  that 
o'  G  CB*  (RAT)  for  all  o'  G  D.  This  proves  the  only  if  direction. 

For  the  “if”  direction,  suppose  that  M  =  (Q.  s.  V'R.\ , . . .  ,V7Zn )  is  appropriate  for  T,  and  oj  G 
CB* (RAT).  We  want  to  show  that  or  =  sfioj)  is  strongly  rationalizable.  Note  that  by  Lemma  2.1,  we 
have  that  for  every  j,  u /  G  CB* (RAT),  the  support  of  VI Zj(u')  is  a  subset  of  CB*  (RAT). 

For  each  player  j,  let  Zj  =  :  c o'  G  CB*(f?2lT)}.  By  definition,  cr*  G  Z^.  For  each  j  and 

each  o'j  G  Zj,  we  now  define  p,ai .  For  o)  G  Zj,  let  =  {oj'  G  CB* (RAT)  :  Sj(oo)  =  cj'}.  Let  pa/ 

be  the  result  of  projecting  ,  T’7Fj(w/)/|D0./ 1  onto  £_j(r).  Since,  for  every  oj'  G  CB*(fMT), 

aj  ° 

the  support  of  VlZj(oj')  is  a  subset  of  CB* (RAT),  we  have  that  the  support  of  pai  is  a  subset  of 
Furthermore,  since  j  is  rational  at  each  state  in  CB* (RAT),  it  follows  that  o'-  is  a  best  response  to  the 
projection  of  Wj(oj')  onto  S_j(r)  for  each  oj'  G  Dct/ ;  thus,  o '•  is  also  a  best  response  to  a  convex 
combination  of  these  projections. 

Finally,  we  need  to  show  that  for  every  strategy  profile  o'  G  Z\  x  . . .  x  Zn  and  all  players  j  and  h,  if 
Rat  (a-n)  >  0  then  pai  (o'_h)  >  0.  So  suppose  that  o'  G  Z\  x  . . .  x  Zn  and  pa>  (o'_A  >  0;  that  is,  there 
exists  some  state  oj'  G  blni  such  that  Wfioj' )(\a'_  Ja/)  >  0.  Since  M  is  a  structure  appropriate  for  F, 
we  must  have  that  Wj(u')(lo'j}M)  =  1-  Thus,  Wj(oj')(\o’\M)  >  0,  and  there  must  be  a  state  oj" 
such  that  VlZj(oj')(oj")  >  0  and  s(oj")  =  o'.  Since  the  support  of  Wj(oj')  is  a  subset  of  CB*(fMT), 
oj"  G  CB*(iL4T),  and  thus  oj"  G  Since  oj"  G  CB* (RAT),  we  have  that  VTZh(oj")(oj")  >  0.  It 
follows  that  p,ai  assigns  positive  probability  to  o'_h.  Thus,  Oi  is  strongly  rationalizable.  | 

We  next  show  that  strongly  rationalizable  strategies  are  in  the  support  of  a  subjective  correlated 
equilibrium  where  the  players’  beliefs  have  common  support.  We  first  recall  the  definitions  of  objective 
and  subjective  correlated  equilibrium. 
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Definition  3.5:  An  ( objective )  correlated  equilibrium  (CE)  in  a  game  F  is  a  distribution  tt  on  F|  ( F)  x 
. . .  x  Sn(r)  such  that,  for  all  players  i  and  strategies  at  G  Sj(r)  such  that  7r(cq)  >  0,  we  have  that  for 

all  a\  g  s,:(r),  _ 

y:  Tr{o-i\<Ji)u(cr)  >  ^  Tr{o-i\oi)u(ol  O-i). 

cr_jGS_i(r)  cr_iGS_i(r) 


I 


In  a  subjective  correlated  equilibrum,  rather  than  there  being  one  common  probability  measure  tt, 
each  player  i  has  her  own  probability  measure  tt,  on  F  ]  (Fj  x  . . .  x  Fr)(F). 

Definition  3.6:  A  subjective  correlated  equilibrium  (SCE)  in  a  game  F  is  a  profile  tt  of  probablity 
measures  onSi(r)x...xSn(r)  such  that  for  all  players  i  and  strategies  at  G  F,  such  that  7ri(cr()  >  0, 
we  have  that  for  all  o\  G  F,;(F), 

y.  TTi((J-i\oi)u(cr)  >  7Ti(cr_j|(Ti)«(cj',cr_j). 


As  pointed  out  by  Aumann,  in  an  SCE  each  player  i  assigns  (subjective)  probability  0  to  the  event  that 
she  wishes  to  deviate  after  receiving  its  signal,  but  some  other  player  j  might  assign  positive  probability 
to  the  event  that  i  wishes  to  deviate.  Aumann  [1974]  suggested  two  method  for  circumventing  this 
problem.  The  first  was  to  require  that  all  the  Trjs  have  the  same  support;  we  call  such  an  SCE  a  common- 
support  subjective  correlated  equilibrium. 

Definition  3.7:  if  is  a  common- support  subjective  correlated  equilibrium  (CS-SCE)  if  it  is  a  SCE  and, 
for  all  players  i  and  j,  the  probability  measures  tt,  and  ttj  have  the  same  support.  | 

Clearly,  if  tt  is  an  objective  correlated  equilibrium,  then  [tt,  . . . ,  tt)  is  a  CS-SCE.  As  the  next  example 
shows,  the  converse  does  not  hold  in  general. 

Example  3.8:  Consider  the  simple  2-player  game  where  Si  =  {L,  R}  and  S2  =  {(,  r}.  The  payoffs  in 
the  game  are  given  in  the  first  table,  7Ti  is  given  in  the  second  table,  and  tt-2  is  given  in  the  third  table. 
We  leave  it  to  the  reader  to  check  that  (ir\,  7^)  is  a  CS-SCE.  Intuitively,  player  1  justifies  his  moves  by 
believing  that  player  2  is  more  likely  to  play  (  when  he  plays  L  and  that  player  2  is  more  likely  to  play 
r  when  he  plays  R:  player  2  has  symmetric  beliefs.  Since  7Ti  /  tt-2,  (7Ti,  7^)  is  not  a  CE. 


L 

R 

TIT 

L 

R 

7 r2 

L 

R 

l 

(1,0) 

(0,1) 

.45 

.05 

t 

.05 

.45 

r 

(0,1) 

(1,0) 

r 

.05 

.45 

r 

.45 

.05 

The  second  (and  seemingly  preferred)  method  of  Aumann  to  circumvent  the  problem  above  was 
to  require  that  the  equilibrium  strategy  remains  optimal  even  after  the  players  receive  their  signal,  no 
matter  what  the  signal  is.  Aumann  called  this  refinement  an  a  posteriori  equilibrium.  This  notion  was 
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further  formalized  by  Brandenburger  and  Dekel  [1987],  who  also  show  that  it  characterizes  the  set  of 
rationalizable  strategies  (and  thus  also  characterizes  strategics  consistent  with  CBR). 

As  we  now  show,  CS-CSE  characterizes  strongly  rationalizable  strategies,  and  thus,  by  Theorem 
3.4,  the  set  of  strategies  consistent  with  CCBR. 

Theorem  3.9:  rr,  is  a  strongly  rationalizable  strategy  for  i  in  a  game  T  iff  there  exists  a  common- support 
subjective  correlated  equilibrium  tt  such  that  ot  is  in  the  support  of  the  projection  ofiTi  onto  E,(T). 

Proof:  For  the  “only  if”  direction,  for  every  player  j,  choose  Zj  C  E;(T)  and  the  probability  mea¬ 
sure  u  /  for  each  strategy  o'-  £  Zj  guaranteed  to  exist  by  Definition  3.3;  define  i r7-  as  the  distri- 
bution  obtained  by  uniformly  sampling  o'j  £  Zj  and  then  sampling  o'_rj  according  to  py\  that  is, 
TTj(d')  =  py (a'_-)/\Zj\.  Clearly  if  is  a  subjective  coiTelated  equilibrium  and  or  is  in  the  support  of 
the  projection  of  tt,  onto  Sj(T)  (since  Oj  £  Zf).  To  show  that  tt  has  common  support,  consider  any 
profile  a' .  For  all  players  j  and  h,  if  tt,  ( o' )  >  0,  then  o'-  £  Z, ,  and  py  ( o'_ ■  j  >  0  (by  construction), 
which  means  that  o'h  £  2),  and  py  (o'_h)  >  0  (by  definition  of  strong  rationalizability);  it  follows  that 

TTh{d')  >  o. 

For  the  “if”  direction,  choose  the  profile  tt  of  probability  measures  guaranteed  to  exist  by  Defini¬ 
tion  3.7.  For  every  player  j,  define  Zj  as  the  support  of  the  projection  of  tt:i  onto  Sj(T),  and  for  every 
strategy  o'j  £  Zj,  define  pyfo'_j)  =  TTj{o'_j\o'j)\  it  follows  that  o'j  is  a  best  response  to  py  ■  Further¬ 
more,  Oi  £  Zi,  since  it  is  in  the  support  of  the  projection  of  7r*  onto  Ej(T).  Since,  for  all  players  j  and  h, 
the  measures  t Tj  and  tt/,  have  the  same  support,  we  have  that  for  all  strategy  profiles  o'  £  Z\  x  . . .  x  Zn 
such  that  py  (</_  ■  )  >  0,  Pa>{a'_h)  >  0.  Finally,  for  all  players  j  and  strategies  o'  £  Zj,  to  see  that  the 

3  J  h  3 

support  of  p  i  is  a  subset  of  , ,  note  that  the  support  of  p  i  is  a  subset  of  the  projection  of  the  support 
of  7 Tj  onto  E_j(T).  The  support  of  pai  is  thus  is  a  subset  of  Z:ih  ,  where  for  all  players  j'  and  h, 

Z'^  is  the  projection  of  the  support  of  it y  onto  E/,  (Tj.  But  since  tt  has  common  support,  we  have  that, 
for  all  players  j'  and  h,  Z3h  =  Z^  =  Zj,  ,  and  thus  the  support  of  py  is  a  subset  of  Z_j.  | 
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A  An  example  separating  CBR  and  CCBR 

As  the  following  example  shows,  CBR  does  not  imply  CCBR  in  general. 
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Example  A.l:  Consider  an  iV-move  centipede  game  [Rosenthal  1982]  viewed  as  a  normal-form  game, 
where  N  >  1  is  even.  More  precisely,  the  action  set  £1  for  player  1  is  {1,  3, . . . ,  N  —  1},  and  the  action 
set  T12  for  player  2  is  {2,  4, ,  N).  (Intuitively,  a  move  of  k  means  that  the  player  first  stops  at  node  /;;.) 
We  take  u\(k,  m)  to  be  2k  +  1  if  k  <  m  and  2m_1  otherwise;  similarly,  we  take  7/2  (fc,  m)  to  be  2m  +  1 
if  rri  <  k  and  2k  1  otherwise.  Thus,  for  example,  if  player  1  stops  at  round  1,  then  player  l’s  utility  is 
3  and  player  2’s  utility  is  1;  if  player  1  stops  first  at  round  3  and  player  2  stops  at  round  2,  then  player 
l’s  utility  is  2  and  player  2’s  utility  is  5.  It  is  easy  to  see  that  all  strategies  are  rationalizable  (that  is,  we 
can  take  Z\  =  £i  and  Z2  =  £2  in  Definition  3.1.)  For  all  strategies  j  €  Z2,  we  can  take  //.;  to  put 
probability  1  on  player  1  playing  1  (stopping  right  away).  This  belief  clearly  justifies  player  2  playing 
j  (i.e.,  stopping  at  j),  for  all  j.  For  strategy  k  €  £  1 ,  let  ///,.  put  probability  1  on  player  2  playing  k  +  1. 
Clearly  this  belief  makes  playing  k  rational.  Thus,  all  strategies  for  both  players  are  rationalizable,  and 
therefore  compatible  with  CBR.  By  way  of  contrast,  as  we  now  show,  the  only  pure  strategy  for  player 
1  that  is  compatible  with  CCBR  is  playing  1 . 

For  definiteness,  we  do  this  for  a  20-move  centipede.  Define  a  ( k ,  /F) -state  to  be  a  state  where  player 
1  plays  k  and  player  2  plays  k' .  We  first  claim  that  there  is  no  (k.  20)-state  with  k  >  1  where  CCBR 
holds.  For  if  uj  is  such  a  20)-state,  then  player  2  must  ascribe  u  positive  probability  at  00.  Consider 
the  largest  k'  such  that  player  2  ascribes  positive  probability  to  a  ( /F ,  20)-state  at  uj.  By  assumption, 
k'  >  1.  Then,  given  his  beliefs,  player  2  is  strictly  better  off  playing  k'  —  1  than  playing  20.  This  is  a 
contradiction.  Thus,  there  is  no  20)-state  compatible  with  CCBR  and  k  >  I . 

It  now  easily  follows  by  Lemma  2.1  that  there  is  no  (19,  A’) -state  compatible  with  CCBR  (because 
playing  19  can  be  justified  for  player  1  only  if  he  ascribes  positive  probability  to  (19,  20),  but,  as  we 
have  just  argued,  there  is  no  such  state  compatible  with  CCBR).  It  follows  that  there  is  no  ( /;: ,  18)- 
state  compatible  with  CCBR  with  k  >  1  (since  a  ( k ,  18)  state  can  be  justified  only  by  a  (19,  k)  state). 
Continuing  in  this  way,  an  easy  induction  shows  that  the  only  state  that  can  be  compatible  with  CCBR 
have  the  form  (1 ,  k).  It  is  also  easy  to  see  that  the  strategies  played  in  these  states  are  in  are  in  fact 
compatible  with  CCBR.  | 

This  example  shows  that  CCBR  implies  that  the  backward  induction  outcome  is  played  in  the  cen¬ 
tipede  game.  It  follows  from  Corollary  B.6  below  and  results  of  Stuart  [1997]  that  the  same  is  true 
in  finitely  repeated  prisoner’s  dilemma.  We  might  hope  that  the  same  is  true  in  all  games  of  perfect 
information,  but  Stuart  [1997,  Figure3a]  gives  a  simple  example  showing  that  this  is  not  the  case  in 
general;  indeed,  in  general,  with  CCBR,  not  even  the  Nash  equilibrium  outcome  is  played.  This  obser¬ 
vation  follows  as  an  easy  corollary  of  our  characterization  of  CCBR  in  terms  of  correlated  equilibria:  all 
(objective)  correlated  equilibrium  strategies  satisfy  CCBR,  and  it  is  already  well  known  that  correlated 
equilibrium  outcomes  arc  not  necessarily  Nash  equilibrium  outcomes. 


B  Relating  CCBR  to  CPA  and  MAC 

In  this  appendix,  we  compare  CCBR  with  (a)  CBR  in  the  presence  of  CPA  and  (b)  Stuart’s  [1997] 
requirement  of  mutual  absolute  continuity. 

We  first  make  precise  what  we  mean  by  CPA. 

Definition  B.l:  A  structure  M  =  (Q.  s.  VIZ  1 , . . .  ,V1Zn)  appropriate  for  F  satisfies  the  CPA  if  there 
exists  a  probability  tt  on  O  and  partitions  ITi . . . . ,  fln  of  D  such  that,  for  all  uj  G  and  players  i,  the 


support  of  VI Zfiu)  is  contained  in  Ilj(w)  (where  II,  (cc)  is  the  cell  of  the  partition  II,  containing  u), 
7r(n,;(ce))  >  0,  and  for  all  u'  £  n(tc),  Wi(u)(u')  =  tt(u'  |  IIj(u;)).  That  is,  Wfiu)  is  obtained  from 
7T  by  conditioning  on  H;(u;).6  | 

Proposition  B.2:  Suppose  that  M  =  (IT  s.  'P'JZ,  . ....  Wn )  is  a  finite  structure  appropriate  for  T 
satisfying  the  CPA.  Then  for  every  state  c a  £  Cl,  if  u  is  i-conservative  for  some  player  i,  then  u  is 
conservative.  Furthermore,  for  every  conservative  state  c o,  we  have 

(a)  u  £  B i(E)  iffu  £  B  1(E),  and 

(b)  u  £  CB (E)  iffu  £  CB *(E). 

Proof:  Since  M  satisfies  the  CPA,  there  is  some  probability  tt  on  O  and  partitions  ITi , . . . ,  IIn  satisfying 
the  conditions  of  Definition  B.l.  By  definition  of  Wi, . . . ,  W„,  we  have  that  if  u  is  i-conservative 
for  some  i,  then  it  is  conservative.  Paid  (a)  follows  from  the  definition  of  B*,  while  paid  (b)  follows  by 
an  easy  induction,  relying  on  the  fact  that  all  i-conservative  states  are  conservative.  I 


Corollary  B.3:  If  M  is  a  structure  that  satisfies  CPA  and  u  £  CB(RAT)  Cl  play  fiof)  for  some  state  u, 
then  Oi  is  strongly  rati onah zable. 

Proof:  Let  M  =  (IT  s.  'P'R.,. . . . .  'P'R.n),  oj.  a,  be  as  in  the  statement  of  Corollary  B.3.  Let  u/  be 
some  state  in  the  support  of  Wfi te);  by  definition  u’  is  i-conservative,  and  thus,  by  Proposition  B.2, 
conservative.  Furthermore,  ur  £  CB(/L4T)  n  ploy  f  af)  which  by  Proposition  B.2  means  that  to  £ 
CB*  (RAT)  Cl  play  fa,).  Thus,  by  Theorem  3.4,  is  strongly  rationalizable.  | 

Turning  to  mutual  absolute  continuity,  we  first  give  Stuart’s  definition  in  our  setting.7 

Definition  B.4:  A  structure  AI  =  (Q,  s.  'P'R.  i . . . . ,  Wn)  appropriate  for  T  satisfies  mutual  absolute 
continuity  if,  for  all  states  uj,  players  i  and  j,  we  have  V1Zi{uj){ u)  >  0  iff  Wj(uj)(uj)  >  0.  | 

We  can  now  prove  a  result  similar  in  spirit  to  Proposition  B.2. 

Proposition  B.5 :  Suppose  that  M  =  (IT  s.  W,  . ....  W,, )  is  a  finite  structure  appropriate  for  T 
satisfying  mutual  absolute  continuity.  Then  for  every  state  u  £  Cl,  if  uj  is  i-conservative  for  some 
i  £  [n\,  then  uj  is  conservative.  Furthermore,  for  every  conservative  state  uj,  we  have 

(a)  uj  £  B,;(I?)  iffu  £  B*(S),  and 

(b)  u  £  CB (E)  iffu  £  CB *{E). 

Proof:  Mutual  absolute  continuity  is  equivalent  to  the  statement  that  all  i-conservative  states  are  con¬ 
servative.  The  rest  of  the  proof  is  identical  to  the  proof  of  Proposition  B.2.  | 


6The  requirement  that  7r(rii(u;))  >  0  is  implicitly  made  by  Aumann,  but  not  by  all  authors  that  consider  the  CPA  (c.f. 
[Halpern  2002]).  Authors  who  allow  7r(II;(a;))  to  be  0  place  no  constraints  on  what  PTZi(oj')  should  be  for  u>'  £  IL(u<). 

7  As  Stuart  [1997]  points  out.  this  definition  of  mutual  absolute  continuity  is  similar  to.  but  not  the  same  as,  the  standard 
definition  of  the  notion. 
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Corollary  B.6:  There  exists  a  finite  structure  M  satisfying  mutual  absolute  continuity  and  a  state  u 
such  that  oj  £  CB(RAT)  n  playftc rft  iff  Oi  is  strongly  rationalizable. 

Proof:  The  “only  if”  direction  follows  just  as  in  Corollary  B.3.  For  the  “if”  direction,  note  that  the  struc¬ 
ture  in  the  proof  of  Theorem  3.4  satisfies  mutual  absolute  continuity  (since  all  states  are  conservative). 


Friedenberg  and  Meier  [2010,  Lemma  8.2]  show  that  a  structure  that  satisfies  the  CPA  also  satis¬ 
fies  mutual  absolute  continuity.  Combining  the  Friedenberg-Meier  result  with  Proposition  B.5  gives 
Proposition  B.2. 
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